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(54) VOICE PICKUP SYSTEM 
(57)Abstract: 

PURPOSE: To realize the voice pickup system 
in which a voice is sent with a high articulation 
without picking up a surrounding noise. 
CONSTITUTION: The voice pickup system 
detecting a bone conduction sound or an air 
conduction sound by a pickup 1 is provided with 

a voice recognition means 2 capable of , J ^ r — - 

recognizing a sound detected by the pickup 1 \\'*" H , . 

and a spectrum generating means 3a using the L - . ^ ^-^ V ^ 

sound data recognized by the voice recognition 
means 2 to generate a spectrum with a 
frequency component when the sound data 
recognized with a conventional microcophone, 
and also with a comparison means 3b 
comparing the sound spectrum detected by the 
pickup 1 with the generated spectrum to obtain 

a missing frequency component, a missing spectrum generating means 3c 
generating a sound of the frequency component missing in the sound detected by 
the pickup 1 as a supplement sound according to the result of comparison by the 
comparator means 3b, and a synthesis means 4 synthesizing the sound detected 
by the pickup 1 with the supplement sound generated by the missing spectrum 
generating means 3c and providing the synthesized output. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1] In the voice pickup system which detects a bone conduction sound or a 
respiratory tract sound by pickup The data of the sound recognized with a speech 
recognition means by which the sound detected by said pickup can be recognized, 
and said speech recognition means are used. A spectrum generating means to 
generate the spectrum of a frequency component when the usual microphone 
detects the data of this recognized sound, A comparison means to ask for the 
frequency component which compares the spectrum which this spectrum 
generating means generated with the spectrum of the sound detected by said 
pickup, and is missing, A lack spectrum generating means to generate the sound 
of the frequency component which the sound detected by said pickup from the 
result of a comparison with said comparison means lacks as a complement sound, 
The voice pickup system characterized by having a synthetic means to compound 
and output the sound detected by said pickup, and the complement sound 
generated with said lack spectrum generating means. 

[Claim 2] The voice pickup system characterized by having a speech recognition 
means by which the sound which detected the bone conduction sound or the 
respiratory tract sound by said pickup in the voice pickup system detected by 
pickup can be recognized, and an artificial sound generation means to generate 
the sound corresponding to the data of the sound recognized with said speech 
recognition means as an artificial sound. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 
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[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the voice pickup system which 
detects a bone conduction sound and a respiratory tract sound by pickup in more 
detail about a voice pickup system. 
[0002] 

[Description of the Prior Art] As a microphone used in the environment where the 
noise exists, the bone conduction sound pickup which detects a bone conduction 
sound is known. 

[0003] This bone conduction sound pickup is stuck on a user s face and head, and 
vibration of the face and the head accompanying utterance of a user is detected. 
Moreover, pickup of a configuration like an earphone is inserted in an external ear 
as a similar microphone, and what detects the respiratory tract sound of external 
auditory meatus exists. 

[0004] The pickup which detects the above bone conduction sounds and a 
respiratory tract sound has the advantage of being easy to detect a user s voice 
made into the purpose, without gathering the surrounding noise comparatively. 
[0005] 

[Problem(s) to be Solved by the Invention] However, when the spectrum of the 
usual voice is 300Hz - 3kHz, as shown in the drawin g 5 property B, it has the 
problem to which a disregard level falls in a frequency domain 1kHz or more. 
[0006] That is, as compared with the sound signal ( drawin g 5 property A) 
detected with the usual microphone, an audio low-pass component is emphasized, 
a high-frequency component becomes sensibility that it falls gradually ( drawingJS 
property B), and detection sounds of pickup of the format which detects voice 
indirectly, such as a bone conduction sound and a respiratory tract sound, have 
the problem to which articulation falls. 

[0007] Drawin g 6 is the property Fig. showing the frequency characteristics at the 
time of actually detecting male voice by bone conduction sound pickup. The 
situation of a fall of a high-frequency component can be read also in this property 
Fig. Although the degrees of a fall of a high-frequency component differ a little in 
fact the pressure at the time of suppressing bone conduction sound pickup on the 
face or a head, according to a male/woman, etc., there is no change in a high- 
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frequency component falling. 

[0008] This invention was made in view of the above-mentioned trouble, and the 
purpose is in offering the voice pickup system which can transmit voice in the 
condition that articulation is high, without gathering the surrounding noise. 
[0009] 

[Means for Solving the Problem] The artificer of this application completes a 
header and this invention for the configuration which can transmit voice with high 
articulation to articulation also in the pickup which detects the bone conduction 
sound which had the problem, and a respiratory tract sound in respect of 
frequency characteristics conventionally, as a result of inquiring wholeheartedly 
that faults, such as articulation expected in the conventional voice pickup system, 
should be improved. 

[0010] Therefore, this invention which is a means to solve a technical problem is 
constituted so that it may explain below. 

(1) Namely, 1st means to solve the above-mentioned technical problem In the 
voice pickup system which detects a bone conduction sound or a respiratory tract 
sound by pickup The data of the sound recognized with a speech recognition 
means by which the sound detected by said pickup can be recognized, and said 
speech recognition means are used. A spectrum generating means to generate the 
spectrum of a frequency component when the usual microphone detects the data 
of this recognized sound, A comparison means to ask for the frequency 
component which compares the spectrum which this spectrum generating means 
generated with the spectrum of the sound detected by said pickup, and is missing, 
A lack spectrum generating means to generate the sound of the frequency 
component which the sound detected by said pickup from the result of a 
comparison with said comparison means lacks as a complement sound, It is the 
voice pickup system characterized by having a synthetic means to compound and 
output the sound detected by said pickup, and the complement sound generated 
with said lack spectrum generating means. 

[001 1] In addition, in such a voice pickup system, it is also possible to carry out 
study for speech synthesis to a system beforehand, and to consider as a lack 
spectrum required since the voice modeled on a user's voice is generated as a 
complement sound generated in a lack spectrum generating means. 
[0012] (2) Moreover, 2nd means solve the above-mentioned technical problem is a 
voice pickup system characterized by to have a speech-recognition means to 
by.which the sound which detected the bone-conduction sound or the respiratory 
tract sound by said pickup in the voice pickup system detected by pickup can be 
recognized, and an artificial sound generation means generate the sound 
corresponding to the data of the sound recognized with said speech-recognition 
means as an artificial sound. 

[001 3] In addition, in such a voice pickup system, it is also possible to also 
generate the voice which was made to carry out study for speech synthesis to a 
system beforehand, and was modeled on a user s voice as an artificial sound 
generated in an artificial sound generation means, and to generate another general 
voice. 
[0014] 
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[Function] In the voice pickup system which is 1 st means to solve a technical 
problem The sound which detected the bone conduction sound or the respiratory 
tract sound by pickup, and was detected by pickup is recognized with a speech 
recognition means. The spectrum of a frequency component when the usual 
microphone detects the data of this recognized sound is generated using the data 
of the sound recognized with the speech recognition means. Thus, it asks for the 
frequency component which compares the generated spectrum with the spectrum 
of the sound actually detected by pickup with a comparison means, and is missing. 
The sound which generated the sound of the frequency component which the 
sound detected by pickup from the result of a comparison with a comparison 
means lacks as a complement sound with the lack spectrum generating means, 
and was detected by pickup, and the complement sound generated with the lack 
spectrum generating means are compounded and outputted in a synthetic means. 
[0015] According to the above voice pickup systems, the clear sound signal near 
the usual voice can be generated by carrying out speech recognition and 
complementing a lack spectrum, after detecting a bone conduction sound and a 
respiratory tract sound, without spoiling the description of his voice. Moreover, it 
is not influenced of the surrounding noise. 

[0016] In the voice pickup system which is 2nd means to solve a technical 
problem, an artificial sound generation means generates the sound corresponding 
to the sound which has recognized the sound which detected the bone conduction 
sound or the respiratory tract sound by pickup, and was detected by pickup with 
the speech recognition means, and has been recognized with the speech 
recognition means as an artificial sound. 

[0017] According to the above voice pickup systems, the clear sound signal near 
the usual voice can be generated now by generating the artificial voice which 
detects a bone conduction sound and a respiratory tract sound, and corresponds 
with the data by which speech recognition was carried out. Moreover, it is not 
influenced of the surrounding noise. 
[0018] 

[Example] One example of this invention is explained to a detail using a drawing. 
<The voice pickup structure of a system (1)> The voice pickup structure of a 
system which is one example of this invention is first explained using draw ing 1 . 
[0019] Pickup 1 is a detection means to detect a bone conduction sound or a 
respiratory tract sound, and a respiratory tract sound microphone corresponds as 
what detects a bone conduction microphone (bone conduction sound pickup) and 
a respiratory tract sound as what detects a bone conduction sound. 
[0020] The speech recognition circuit 2 is a circuit which recognizes well-known 
voice or well-known syllable, and whether it learns each description part of a user 
or it does not perform such study, it is not cared about. 

[0021] The complement sound generation circuit 3 is a kind of artificial sound 
generating circuit which generates the sound of the frequency component which 
the sound detected by pickup 1 lacks using the data of the sound (voice, syllable) 
recognized in said speech recognition circuit 2 as a complement sound. Moreover, 
this complement sound generation circuit 3 consists of spectrum generating 
circuit 3a, comparator circuit 3b. and lack spectrum generating circuit 3c. 
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[0022] Spectrum generating circuit 3a generates a spectrum when the recognized 
sound is detected by the usual microphone using the data of the sound 
recognized in said speech recognition circuit 2. Comparator circuit 3b compares 
the spectrum which said spectrum generating circuit 3a generated with the 
spectrum of the sound detected by said pickup. Lack spectrum generating circuit 
3c generates the spectrum (lack spectrum) of a part according to the difference 
of a spectrum as a complement sound according to the comparison result of 
comparator circuit 3b. 

[0023] The synthetic circuit 4 is an output means to compound and output the 
sound (a bone conduction sound, respiratory tract sound) detected by pickup 1 , 
and the complement sound generated in the complement sound generation circuit 
3. 

Actuation of the voice pickup system which is one example of <actuation [ of a 
voice pickup system ] (1)> this invention is constituted by each step of **, **. **, 
**, **, and ** as roughly divided and shown below. Order is explained for this step 
later on. 

[0024] ** Detection of a sound (a bone conduction sound, respiratory tract 
sound) : detect a bone conduction sound or a respiratory tract sound using pickup 
1. 

** Recognition of a sound (a bone conduction sound, respiratory tract sound) : 
recognize the detection sound of pickup 1 in the speech recognition circuit 2. In 
this case, you may be any although recognition by the single sound or recognition 
by syllable changes with recognition approaches of the speech recognition circuit 
2. Moreover, it does not matter whether it learns and recognizes a user s voice, or 
it recognizes without performing study which specified the user. 
[0025] ** Spectrum generating of a recognition sound : generate the spectrum 
(this is hereafter called spectrum of a standard sound) which will be obtained 
when spectrum generating circuit 3a detects with the usual microphone using the 
data of a recognition sound. For this reason, the spectrum which spectrum 
generating circuit 3a shall have the spectrum according to a recognition sound (a 
single sound, syllable), and corresponds according to a recognition sound is called. 

[0026] As a spectrum in this case, you may have a spectrum for every user and 
may have a standard spectrum. Moreover, when it has a standard spectrum, you 
may make it have some spectrums like an adult male, an adult woman, and a child. 

[0027] ** The spectrum comparison with a standard sound and a detection 
sound : compare the spectrum of the spectrum of a standard sound, and a 
detection sound in comparator circuit 3b. 

[0028] For example, if it explains using drawin g 5 , the lack spectrum C of a 
detection sound (= A-B) will be computed for every recognized detection sound 
by comparing the spectrum A of a standard sound with the spectrum B of a 
detection sound. 

[0029] ** Complement sound (lack spectrum) generating : according to the data 
of the lack spectrum obtained by comparator circuit 3b, lack spectrum generating 
circuit 3c generates the signal of a lack spectrum. Also in this case, as a 
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generated lack spectrum, you may have a spectrum for every user and may have 
a standard spectrum like spectrum generating circuit 3a. Moreover, when it has a 
standard spectrum, you may make it have some spectrums like an adult male, an 
adult woman, and a child. 

[0030] Composition with a detection sound and a complement sound : 
compound a lack spectrum and the spectrum of a detection sound in the 
synthetic circuit 4. By this synthetic processing, the lack spectrum of a detection 
sound is added as a complement sound, and the composite tone of a spectrum 
equivalent to a standard spectrum is acquired. Therefore, a sound signal 
equivalent to what collected the sound with the standard microphone is acquired. 
[0031] in addition, a complement sound — a user — although the composite tone 
acquired as a result of being compounded, when belonging to him also becomes 
his thing, even if based on data with a standard complement sound, since the part 
of a complement sound is only a part of a high region, there is very little sense of 
incongruity. 

[0032] In addition, as shown in drawing 2 , it is possible to have individual data 
memory 3d, to record [ voice / of a user ] beforehand (sampling), and to store the 
data of the description part to generate the lack spectrum according to a user s 
voice. 

[0033] Moreover, what the quality of a user s voice is judged and chooses a near 
thing automatically out of the standard spectrum with which lack spectrum 
generating was equipped is possible. 

<the effectiveness acquired by the configuration (1)> — according to the above 
voice pickup systems, the clear sound signal near the usual voice can be 
generated by carrying out speech recognition and complementing a lack spectrum, 
after detecting a bone conduction sound and a respiratory tract sound, without 
spoiling the description of his voice. Moreover, it is not influenced of the 
surrounding noise. 

[0034] Moreover, about a meaningless sound, although detected by pickup like 
******, since semantics is not made by processing of speech recognition, a 
complement sound is not generated. Therefore, since only the low-pass 
component detected by pickup is outputted, there are few bad influences. 
[0035] <The voice pickup structure of a system (2)> The voice pickup structure 
of a system which is the second example of this invention is first explained using 
drawin g 3 . 

[0036] Pickup 1 is a detection means to detect a bone conduction sound or a 
respiratory tract sound, and a respiratory tract sound microphone corresponds as 
what detects a bone conduction microphone and a respiratory tract sound as 
what detects a bone conduction sound. 

[0037] The speech recognition circuit 2 is a circuit which recognizes well-known 

voice or well-known syllable, and whether it learns each description part of a user 

or it does not perform such study, it is not cared about. 

[0038] The artificial sound generating circuit 5 generates the artificial sound 

corresponding to the sound detected by pickup 1 using the data of the sound 

(voice, syllable) recognized in said speech recognition circuit 2. 

[0039] Actuation of the voice pickup system which is one example of <actuation 



[ of a voice pickup system ] (2)> this invention is constituted by each step of **, 
**. and ** as roughly divided and shown below. Order is explained for this step 
later on. 

[0040] ** Detection of a sound (a bone conduction sound, respiratory tract 
sound) : detect a bone conduction sound or a respiratory tract sound using pickup 
1. 

Recognition of a sound (a bone conduction sound, respiratory tract sound) : 
recognize the detection sound of pickup 1 in the speech recognition circuit 2. In 
this case, you may be any although recognition by the single sound or recognition 
by syllable changes with recognition approaches of the speech recognition circuit 
2. Moreover, it does not matter whether it learns and recognizes a user s voice, or 
it recognizes without performing study which specified the user. 
[0041] ** Spectrum generating of a recognition sound : generate the standard 
spectrum which will be obtained when the artificial sound generating circuit 5 
detects with the usual microphone using the data of a recognition sound. For this 
reason, the spectrum which the artificial sound generating circuit 5 shall have the 
spectrum according to a recognition sound (a single sound, syllable), and 
corresponds according to a recognition sound is called. 

[0042] As a spectrum in this case, you may have a spectrum for every user and 
may have a standard spectrum. Moreover, when it has a standard spectrum, the 
configuration which changes and uses them like an adult male, an adult woman, 
and a child as has some spectrums may be used. Therefore, a sound signal 
equivalent to what collected the sound with the standard microphone is acquired. 
[0043] In addition, as shown in drawin g 4 , it is possible to have the individual data 
memory 6, to record [ voice / of a user ] beforehand (sampling), and to store the 
data of the description part to generate the lack spectrum according to a user s 
voice. 

[0044] Moreover, what the quality of a users voice is judged and chooses a near 
thing automatically out of the standard spectrum with which lack spectrum 
generating was equipped is possible. 

<the effectiveness acquired by the configuration (2)> — according to the above 
voice pickup systems, the clear sound signal near the usual voice can be 
generated now by generating the artificial voice which detects a bone conduction 
sound and a respiratory tract sound, and corresponds with the data by which 
speech recognition was carried out. Moreover, it is not influenced of the 
surrounding noise. 

[0045] Moreover, about a meaningless sound, although detected by pickup like 
******, since semantics is not made by processing of speech recognition, an 
artificial sound is not generated. Therefore, since it is not outputted, there are few 
bad influences. 

[0046] <other desirable examples> — although various kinds of application is 
possible for the above voice pickup systems, it is possible to use it under a noise 
environment, including in the various systems which transmit voice. For example, 
clear transmission is attained by including in devices, such as a cellular phone. 
And it also has the advantage of not being heard against a surrounding sound. 
[0047] 
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[Effect of the Invention] According to the above voice pickup systems, the clear 
sound signal near the usual voice can be generated by carrying out speech 
recognition and complementing a lack spectrum, after detecting a bone 
conduction sound and a respiratory tract sound, without spoiling the description of 
his voice. Moreover, it is not influenced of the surrounding noise. Therefore, the 
voice pickup system which can transmit voice in the condition that articulation is 
high can be realized, without gathering the surrounding noise. 
[0048] Moreover, the clear sound signal near the usual voice can be generated 
now by generating the artificial voice which detects a bone conduction sound and 
a respiratory tract sound, and corresponds with the data by which speech 
recognition was carried out. Moreover, it is not influenced of the surrounding 
noise. Therefore, the voice pickup system which can transmit voice in the 
condition that articulation is high can be realized, without gathering the 
surrounding noise. 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing !] It is the block diagram showing the voice pickup structure of a system 
of one example of this invention. 

[ Drawin g 2] It is the block diagram showing the configuration of the modification of 
the voice pickup system of one example of this invention. 

[ Drawin g 3] It is the block diagram showing the voice pickup structure of a system 
of the second example of this invention. 

[D rawin g 4] It is the block diagram showing the configuration of the modification of 
the voice pickup system of the second example of this invention. 
[ Drawin g 5] It is the property Fig. showing an audio spectrum typically. 
[ Drawin g 6] It is the property Fig. showing the observation result of an audio 
spectrum. 

[Description of Notations] 

1 Pickup 

2 Speech Recognition Circuit 

3 Complement Sound Generation Circuit 
3a Spectrum generating circuit 

3b Comparator circuit 

3c Lack spectrum generating circuit 

4 Synthetic Circuit 
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[ Drawin g 3] 



[ Drawin g 4] 
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[ Drawin g 2] 
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